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Editor's  Note:   This  article  is  a  con- 
densed version  of  a  paper  presented  at  the 
Fifth  Annual  Convention  of  the  Association 
for  Behavior  Analysis,  Dearborn,  Michigan, 
June,  19,  1979.   Complete  copies  of  the 
paper  are  available  from  the  first  author, 
Boulder  River  School  and  Hospital,  Boulder, 
Montana,  59632. 

Introduction 

Recently  within  the  United  States,  the 
care,  training,  and  habilitation  of  the 
institutionalized  retarded  has  become  a 
major  social  issue.   Concerns  with  the 
right  to  treatment,  the  movement  to  con- 
vert institutions  to  training  facilities, 
and  the  emphasis  on  the  developmental 
model  and  the  normalization  principle  have 
resulted  in  many  institutions  pursuing 
staff  training  models  to  facilitate  the 
conversion  from  custodial-oriented  facil  - 
ities  to  training  facilities. 

The  importance  of  adequate  staff  training 
has  been  emphasized  by  many  authors,  such 
as  Watson,  Gardner,  and  Sanders  (J 971)  and 
Gardner  (1972),  and  the  increasing  demand 
for  behavioral  programs  within  institu- 
tional settings  likewise  has  increased  the 
need  for  training  non-professional  staff 
to  be  behavioral  engineers.   Direct  care 
staff  often  number  as  much  as  50%  of  an 
institutions' s  employee  population  (Iwata, 
Brown,  Bailey,  Foshee,  and  Alpern,  1976), 
and  since  they  are  in  constant  direct 
contact  with  the  residents,  they  consti- 
tute an  invaluable  resource  as  behavior- 
change  agents. 

Generally,  many  administrators  within 
institutions  have  assumed  that  in-st-rvice 


training  for  direct-care  staff  leads  to 
improved  staff  performance  and,  finally, 

to  more  effective  service  programs  (Quil- 
itch,  1975).   Investigators  who  have 
attempted  to  evaluate  the  effects  of  in- 
service  training  on  subsequent  staff 
performance  (Gardner,  1973;  Cochran  and 
Steiner,  1966;  Johnson  and  Ferryman,  1969; 
Panyon  and  Patterson,  1974)  have  demon- 
strated that  in-service  training  can 
increase  verbal  knowledge  and  training 
skills,  but  studies  in  which  staff  or 
resident  behavior  was  repeatedly  monitored 
have  suggested  that  in  many  cases,  instruc- 
tions, in-service  training  and  the  devel- 
opment of  job  assignments  can  be  expected 
to  have  relatively  small  (Martin,  1972), 
temporary  (Hollander,  Plutchik  and  Horner, 
1973;  Panyon,  Boozer  and  Morris,  1970),  or 
negligible  effects  (Hollander  and  Plutchik, 
1972;  Katz,  Johnson  and  Gelfand  1972; 
Quilitch,  1975)  on  the  staff's  actual  work 
performance. 

Unfortunately,  the  available  research 
does  not  bear  out  the  optimistic  assump- 
tions made  by  many  about  the  value  of  in- 
service  training.   Consequently,  existing 
staff  training  models  are  being  scrutinized 
with  the  realization  that  traditional 
institutional  pre-service  and  in-service 
training  models  sometimes  serve  little 
purpose  but  to  perpetuate  the  maintenance 
of  inadequate  existing  systems. 

Development  of  the  Model 

In  1975,  Boulder  River  School  and  Hos- 
pital was  attempting  to  comply  with  recent 
federal  and  state  "right  to  treatment" 
laws  which  mandated  that  the  facility 
provide  habilitative  treatment  to  all 
institutionalized  residents.   In  order  to 
comply  with  the  laws,  it  became  obvious 
that  the  institution  would  either  have  to 
hire  a  large  contingent  of  professional 
therapists  and  training  specialists  or 
develop  a  staff  development  program  to 
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train  direct-care  workers  to  become' com-  " 
petent,  paraprofessional  treatment  agents. 
The  latter  solution  was  chosen,  and  in 
January  of  1976  the  staff  of  Boulder  River 
School  and  Hospital  began  to  replicate  the 
Teaching  Research  Model,  developed  by  the 
Teaching  Research  Infant  and  Child  Center 
in  Monmouth,  Oregon.   During  the  first 
year  of  operation  the  original  Teaching 
Research  Model  underwent  many  changes  and 
evolved  into  the  Boulder  Training  Model 
(BTM) .   The  demonstration  classroom,  a 
major  component  of  the  model,  was  also 
modified  and  became  known  as  the  Boulder 
Training  Center  (BTC) .   In  essence,  the 
Boulder  Training  Model  became  a  complete 
system  of  establishing,   delivering, 
monitoring,  and  maintaining  habilitative 
training  and  behavior  management  programs 
within  the  institution. 

Components  of  the  Model 

In  the  Boulder  Training  Center,  staff  are 
instructed  in  resident  training  techniques 
and  in  the  overall  system  of  data  collec- 
tion and  analysis.   Direct-care,  manage- 
ment, and  support  staff  are  trained  in  a 
one-week,  35-hour  course.   The  course 
consists  of  approximately  four  hours  per 
day  of  practical,  or  "hands  on",  training, 
in  which  trainees  learn  to  run  1:1  skill 
acquisition  programs,  conduct  activity 
areas  (group  programs),  conduct  table 
manners  training,  and  interact  appropri- 
ately with  the  seven  residents  who  are  BTC 
students.   Trainees  spend  another  three 
hours  per  day  in  an  academic  classroom 
setting,  where  they  are  introduced  to  the 
basic  principles  of  behavior  modification, 
behavior  measurement  techniques,  analysis 
of  data,  called  "updating",  and  behavior 
intervention  techniques.   In  a  typical 
week,  a  group  of  trainees  consists  of  six 
to  eight  employees.   Thus,  the  ratio  of 
instructors  to  trainees  is  one  to  two, 
which  allows  the  trainees  to  t>e  monitored 
continually  through  the  intense  "hands  on" 
activities. 

The  seven  residents  who  participate  in 
training  programs  in  the  BTC  are  selected 
from  several  cottages  within  the  institu- 
tion.  These  residents  exhibit  a  wide 
range  of  skills  and  behavior  problems,  and 
they  provide  the   trainees  with  both 
familiar  and  unfamiliar  behavioral  reper- 
toires. 


Ottnng  th*3|pj|^^riing  week,  the  trainees 
have  no  resporrRbil  ities  other  than  attend- 
ing the  BTC.   The  trainees'  performance  is 
geared  toward  meeting  twelve  specific, 
criterion-based  training  objectives  that 
are  directly  related  to  their  cottage 
training  responsibilities. 

Assessment  tools  used  during  the  training 
week  vary  from  one  objective  to  the  next. 
For  practical  training  objectives,  of 
which  there  are  seven,  evaluation  check- 
list forms  have  been  developed  to  objec- 
tively rate  specific  training  behaviors, 
such  as  the  delivery  of  cues,  consequen- 
ces, the  recording  of  data,  and  so  on. 
Performance  on  tVie  five  academic  objec- 
tives is  measured  with  a  variety  of 
written  exercises.   For  instance,  up- 
dating, one  of  the  academic  skills  taught, 
consists  of  trainers  analyzing  program 
data  and  deciding  how  to  advance  a  student 
through  or  make  changes  to  the  task  analy- 
sis of  an  individual  training  program. 

Eleven  of  the  12  objectives  carry  per- 
formance criteria  of  90%  accuracy.   The 
sole  exception,  the  rotation  of  trainer's 
attention  to  the  students  in  the  activity 
area,  has  a  criterion  of  100%.   These 
relatively  high  criteria  were  chosen  as  a 
means  of  insuring  consistency  in  training 
techniques  and  in  the  hopes  of  facili- 
tating maintenance  of  training  skills. 

General ization  of  the  Model 

For  a  typical  cottage  (about  25  staff), 
there  are  four  training  weeks  in  the  BTC 
classroom.   Following  this  training,  the 
BTC  instructors  accompany  the   trained 
staff  back  to  their  work  area  and  begin  a 
three-week  period  known  as  "follow-up". 
During  follow-up,  the  BTC  and  cottage 
staffs  work  together  to  insure  that  the 
model  is  fully  implemented  within  the 
cottage.   Follow-up  begins  with  the  BTC 
instructors  and  cottage  supervisory  staff 
targeting  specific  objectives,  based  on 
the  results  of  a  standardized  cottage 
assessment  checklist  completed  by  the  BTC 
staff. 

Also  during  follow-up,  the  BTC  staff 
observes  cottage  staff  conducting  individ- 
ual, group,  and  mealtime  training  programs 
with  the  cottage  residents.   The  instruc- 
tors rare  training  performance  and  give 
feedback  the  same  as  in  the  classroom  as  a 
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means  of  generalizing  classroom  skills  to 
specific  work  duties. 

At  the  end  of  the  follow-up  period,  the 
BTC  staff  again  conducts  a  cottage  assess- 
ment, pinpointing  specific  strengths  and 
deficits  regarding  the  model's  implemen- 
tation in  the  cottage.   From  this  infor- 
mation, a  final  list  of  recommendations 
for  cottage  supervisory  personnel  is 
prepared.   Following  the  BTC's  interven- 
tion, assessments  by  supervisory  staff 
continue  on  a  quarterly  basis.   A  training 
specialist  in  each  cottage  assesses  indi- 
vidual trainer's  performance  each  month, 
and  these  assessments  are  included  in  the 
overall  work  evaluation  of  the  trainers. 

Results 

Since  January  1,  1976,  the  Boulder  Train- 
ing Center  has  trained  approximately  700 
staff  at  the  average  cost  of  $325  per 
trainee.   Sixty-eight  percent  of  these 
staff  were  direct-care  workers,  while  the 
remaining  32%  were  administrative,  support, 
or  professional  staff.   During  training, 
each  trainee  was  required  to  meet  criterion 
on  12  training  objectives.   Of  these  12, 
nine  were  chosen  for  discussion  in  this 
report  because  of  their  relationship  to 
the  direct  training  duties  of  direct-care 
staff. 

Of  the  entire  population  of  direct-care 
staff  trained,  195  were  randomly  selected 
from  BTC  training  files,  and  the  mean 
scores  were  complied  on  their  "first"  and 
"best"  attempts  at  each  of  the  nine  objec- 
tives.  It  is  important  to  note  that  the 
first  attempt  scores  here  are  not  true 
baseline  scores,  since  each  trainee  had 
received  verbal  instructions,  a  videotape 
model,  and  a  live  demonstration  of  the 
behaviors  prior  to  his  or  her  first  attempts. 

First  Best  Mean  % 

Objectives         Attempt  Attempt  Of  Change 

1:1  Cues           76.0%  98.7%  +22.7% 

1:1  Consequences    71.6%  98.2%  +26.6% 

1:1  Data  Recording  85.9%  99.8%  +26.6% 

Group  Cues         81.6%  98.1%  +16.5% 

Group  Consequences  80.37.  96.9%  +16.6% 

Group  Rotation      55.0%  98.5%  +43.4% 

Terminology         78.9%  94.8%  +15.9% 

Updating            80.9%  91.6%  +10.7% 
Incidental 
Interactions       80.6% 


95.4%   +14.8% 
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On  each  of  the  nine  objectives  examined, 
an  increase  was  observed  from  the  first 
attempt  scores.   The  objectives  showing 
the  largest  increases  all  related  to 
practical,  or  "hands  on",  training  objec- 
tives. 

During  follow-up  periods,  the  BTC  instruc- 
tors assisted  the  newly  trained  staff  in 
the  generalization  of  their  skills  to 
training  duties  in  the  actual  work  areas. 
Overall,  74%  of  direct-care  staff  met  all 
1:1  program  objectives  on  their  first 
evaluation  in  the  cottage;  92%  met  all 
group  program  objectives  on  their  initial 
follow-up  observations,  and  88%  met  criteria 
on  the  appropriateness  of  incidental 
interactions  on  the  initial  follow-up 
observations.   Reliability  between  obser- 
vers during  the  follow-up  observations  was 
consistently  above  90%. 

Maintenance  of  the  Model 

The  BTC  spent  nearly  three  years  training 
the  staff  from  15  separate  cottages.   The 
BTC  staff  returned  to  these  cottages 
during  December  of  1978  and  January  of 
1979  to  determine  the  level  of  maintenance 
of  these  training  skills.   The  same  tools 
that  were  used  to  evaluate  trainees  during 
the  classroom  and  follow-up  phases  were 
also  used  In  the  maintenance  evaluation. 

In  the  maintenance  evaluation,  23  train- 
ers were  observed,  and  the  mean  scores  for 
each  of  the  nine  selected  objectives  were 
compiled.   In  addition,  the  group's  mean 
classroom  scores  for  the  first  and  best 
attempts  on  each  objective  were  compiled. 
These  data  are  presented  below. 

On  each  of  the  nine  objectives  examined, 
increases  were  observed  between  the  first 
attempt  and  best  attempt  scores.   The  in- 
creases for  all  objectives  ranged  from  7.8% 
to  47.5%.   The  maintenance  evaluation  scores 
generally  dropped  to  a  level  that  was  slightly 
above  the  first  attempt  scores. 

Discussion 

The  Boulder  Training  Model  offers  several 
advantages  over  traditional  staff  develop- 
ment programs:   1)  it  is  a  complete  system 
of  staff  and  resident  training  that  is 
less  likely  to  be  affected  by  a  high  staff 
turnover  rate;  2)  it  has  as  a  cornerstone, 
an  efficient  demonstration  classroom  that 
can  teach  all  aspects  of  the  model  to  any 
employee  in  one  intensive  week  of  train- 
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First 

Best 

Maintenance 

Objectives 

Attempt 

Attempt 

Score 

1 : 1  Cues 

64.8% 

98.3% 

80.4% 

1 : 1  Consequences 

67.9% 

96.9% 

71.0% 

1:1  Data  Recording 

92.2% 

100.0% 

9  3.0% 

Group  Cues 

75.3% 

98.3% 

84.7% 

Group  Consequences 

80.4% 

96.7% 

82.0% 

Group  Rotation 

52.5% 

100.0% 

85.7% 

Terminology 

75.0% 

95.5% 

84.7% 

Updating 

76.3% 

94 . 3% 

62.3% 

Incidental 

Interactions 

85.2% 

95.4% 

88.9% 

Mean 

74.4% 

97.3% 

81.4% 

ing;  3)  the  model  is  data-based,  elimin- 
ating the  guesswork  from  treatment  and 
management  decisions;  and  4)  the  model  is 
relatively  inexpensive  when  compared  to 
the  alternative  cost  of  hiring  an  adequate 
number  of  professional  therapists. 

In  addition,  as  part  of  the  model,  the 
Boulder  Training  Center  overcomes  several 
problems  inherent  in  most  traditional 
staff  development  programs.   First,  the 
BTC  teaches  the  actual  behaviors  expected 
of  staff  in  the  work  area.   In  traditional 
staff  training  programs,  students  are 
often  taught  verbal  skills  that  they  must 
then  translate  into  performance  skills  for 
application  in  the  work  environment. 
Second,  most  training  programs  stop  after 
the  class  ends,  with  the  assumption  that 
skill  generalization  will  occur  naturally. 
BTC  training  ends  in  the  actual  work 
environment,  three  weeks  after  classroom 
training.   This  follow-up  makes  it  more 
likely  that  generalization  will  occur  and 
that  the  model  will  be  effectively  imple- 
mented.  Finally,  the  issue  of  consistency 
within  and  across  staffs  is  addressed  by 
centralized  staff  training  and  monitoring 
of  their  performance. 

The  data  that  have  been  collected  to 
assess  the  effects  of  the  BTM  indicate 
that  it  is  an  effective  method  of  training 
employees  to  conduct  habilitative  training 
programs  and  of  assisting  them  to  general- 
ize those  skills  to  a  variety  of  work 
environments  within  the  institution.   The 
evaluation  of  the  maintenance  of  trainers' 
skills  indicates  some  loss  of  skills  over 
time.   However,  on  seven  of  the  nine 
objectives,  the  trainers'  scores  were 
still  above  those  achieved  on  the  first 


classroom  attempts,  which  were  preceded  by 
instructions,  video-tapes,  and  live  models. 
The  mean  scores  received  on  the  academic 
and  practical  objectives  at  the  mainten- 
ance observation  was  81.4%.   Although  this 
was  less  than  the  desired  90%  criterion, 
these  results  suggest  that  the  training 
has  positively  affected  employees'  training 
skills. 

An  analysis  of  the  monitoring  and  feed- 
back systems  of  the  model  in  the  cottages 
is  needed,  and  modifications  must  be  made 
so  that  trainers  will  consistently  meet  or 
exceed  the  90%  criterion  in  their  work 
areas .  

Trainee  feedback  relating  to  the  quality 
and  usefulness  of  the  training  project  has 
been  positive,  and,  since  the  implem- 
entation of  the  model,  the  amount  of 
habilitative  training  provided  to  the 
residents  by  direct-care  staff  has  steadily 
increased.   (These  data  are  included  in 
the  complete  version  of  this  paper  and 
available  upon  request.) 
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A  MAINTENANCE  STRATEGY  FOR  STAFF 
TRAINING 

BY  GARY  ADAMS  &  BARBARA  L.  MATLOCK 

Many  types  of  reinforcement  have  been 
used  to  alter  the  training  performance  of 
teachers  or  institutional  staff.   Time  off 
(Watson,  Gardner  and  Sanders,  1971), 
selecting  work  shifts  (Ayllon  and  Azrin, 
1968),  money  (Pomerleau,  Bobrove  and 
Harris,  1972),  tokens  or  coupons  (Poimner 
and  Streedbeck,  1974),  and  selecting  days 
off  (Iwata,  Bailey,  Brown,  Foshee  and 


Alpern,  1976),  are  a  few  examples  of 
reinforcers  that  have  been  used  success- 
fully to  improve  trainer  performance. 
Although  these  reinforcers  and  others  have 
improved  trainer  performance  during  the 
experimental  interventions,  reviewers  of 
staff  training  have  noted  the  lack  of 
follow-up  by  researchers  (Gardner,  1973; 
Kazdin  and  Moyer,  1976;  Loeber,  1974).   In 
general,  studies  with  follow-up  data  have 
shown  little  or  no  maintenance  of  the 
behaviors  under  study  (Brown,  Montgomery 
and  Barclay,  1969;  Cooper,  Thompson  amd 
Baer,  1970;  Cotler,  Applegate,  King  and 
Kristal,  1972;  Hall,  1971;  Kazdin,  1974; 
Martin,  1972;  Pomerleau,  Bobrove  and 
Smith,  1973).   Even  though  it  would  appear 
that  creating  a  successful  maintenance 
strategy  should  be  a  major  objective  of 
researchers,  it  has  not  been  adequately 
examined  in  the  literature. 

The  present  study  has  two  purposes:   1) 
to  analyze  various  components  of  staff 
training,  and  2)  to  evaluate  a  strategy 
for  maintaining  training  behavior.   Delay- 
ed, graphic  feedback  was  given  on  a  faded, 
variable  schedule  during  the  maintenance 
strategy.   Its  effect  on  trainer  perfor- 
mance was  evaluated  with  three  follow-up 
observations. 

METHOD 

Setting 

Staff  on  the  morning  shift  in  one  cottage 
at  Boulder  River  School  and  Hospital  were 
observed  during  this  study.   The  cottage 
contained  32  profoundly  retarded  female 
clients.   The  staff  members  had  completed 
an  intensive,  one-week  inservice  training 
workshop  on  behavior  modification  and 
skill  training  about  one  month  before  the 
onset  of  this  study. 

Measurement 

The  staff  were  observed  during  the  resi- 
dents' lunch  period  on  Tuesdays  through 
Saturdays.   The  observer,  who  was  in  the 
dining  room,  wrote  down  the  names  of  the 
staff  in  the  room  (usually  three  or  four 
trainers).   A  time  sampling  procedure  was 
used.   Every  15  seconds  the  observed  staff 
member's  behavior  would  be  recorded  in  one 
or  more  of  the  following  categories: 
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(Appropriate  trainer  behaviors) 
Appropriate  Help  —  physically  as- 
sisting a  client's  hand(s) 
Cue-Coasequence  - —  giving  an  appro- 
priate cue  followed  by  socially 
reinforcing  or  correcting  the  client's 
response. 

Consequences  —  a  reinforcing  response 
by  the  trainer  to  a  client 

(Inappropriate  trainer  behaviors) 
Inappropriate  help  —  physically 
performing  a  task  for  a  client, 
rather  than  offering  assistance 
Cue-No  Consequence  —  giving  a  cue, 
but  not  socially  reinforcing  a  correct 
response  or  correcting  an  incorrect 
response 

Inappropriate  Cue  —  asking  a  question 
of  a  non-verbal  resident  (e.g.,  "Do 
you  want  some  bread?") 
Multiple  Cue  —  giving  more  than  one 
cue  without  following  each  cue  with  a 
reinforcer  or  a  correction  procedure 
No  Response  —  no  trainer  behavior 
toward  any  client" 

Staff  Interaction  —  talking  to  other 
trainer(s).   This  was  rated  as  neutral 
if  the  observed  trainer  was  also 
doing  an  appropriate  behavior  without 
any  inappropriate  behavior. 

The  first  staff  member  on  the  data  sheet 
was  observed  for  one  minute  (four  15- 
second  samples).   Then  the  next  staff 
member  was  observed,  then  the  third,  and 
so  on,  until  each  staff  member  had  been 
observed  for  five  minutes.   If  a  staff 
member  was  out  of  the  dining  room  during 
his  or  her  observation  interval,  that 
particular  sample  was  eliminated  from  all 
calculations. 

A  15-second  sample  was  counted  as  appro- 
priate if  it  contained  at  least  one  of  the 
appropriate  behaviors  above  and  none  of 
the  inappropriate  behaviors.   This  method 
of  calculation  results  in  a  conservative 
measure  of  appropriate  staff  behavior, 
especially  within  the  constraints  of  a  15- 
second  time  sample.   Often  a  staff  member 
would  give  a  cue  during  the  first  time 
sample  and  then  reinforce  the  response  to 
that  cue  during  the  second  time  sample. 
The  first  sample,  of  course,  would  be 
marked  as  inappropriate. 

Reliability  checks  by  two  independent 
observers  were  conducted  throughout  this 


study  on  a  weekly  basis.   The  average 
reliability  of  the  15  observations  taken 
was  94%,  with  a  range  of  89%  to  99%. 

Procedure 

An  ABCBCDB  experimental  design  was  used 
in  this  study.   The  experimental  conditions 
consisted  of  the  following  phases: 
Phase  2.  (baseline)  —  During  baseline,  the 
staff  were  observed  without  intervention. 
The  supervisor  of  the  cottage  expected  the 
staff  to  follow  the  training  guidelines 
that  they  were  taught  during  the  inservice 
workshop,  but  no  active  demands  were 
placed  on  the  staff. 

Phase  2_     (signs  and  grouping)  —  After 
obtaining  information  from  staff,  the 
residents  were  grouped  according  to  the 
level  of  their  eating  skills.   This  homo- 
genous grouping  strategy  replaced  a  heter- 
ogenous grouping.   In  addition,  mobiles 
were  hung  above  the  clients'  tables. 
Signs  with  individualized  mealtime  target 
behaviors  (usually  two  for  each  resident) 
were  placed  on  the  mobile  above  each 
resident's  place.   Each  sign  also  had  a 
reminder  to  socially  reinforce  appropriate 
eating  behavior  and  to  let  the  residents 
do  things  for  themselves. 

Phase  3i  (signs,  grouping,  and  feedback)  — 
An  experimenter  began  reinforcing  appro- 
priate training  behavior  and  giving  cor- 
rective feedback  to  staff  during  this 
phase.   A  shaping  procedure  was  used  to 
socially  reinforce  improvements  in  staff 
behavior.   The  corrective  feedback  usually 
centered  around  inappropriate  help,  lack 
of  consequences  following  cues,  or  a 
generally  low  level  of  social  reinforce- 
ment toward  the  client. 

Phase  4^  (follow-up)  --  After  six  days  of 
the  feedback  phases,  the  experimenter 
stopped  giving  feedback  to  the  staff. 
Follow-up  data  were  taken  on  the  first  day 
after  feedback  was  stopped  and  then  at 
seven-day  intervals  for  three  weeks. 
Phase  _5  (reinstatement  of  feedback)  — 
Feedback  to  staff,  as  in  Phase  3,  was 
again  given  during  this  phase. 
Phase  6^  (maintenance   strategy:  delayed 
feedback,  graphic  feedback,  and  fading)  — 
Immediate  verbal  feedback  was  stopped, 
although  the  observer  continued  taking 
data  during  lunch.   At  the  end  of  the 
meal,  the  observer  calculated  the  percent- 
ages of  appropriate  staff  behavior  on  an 
individual  and  a  group  basis.   These  data 
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were  transferred  to  individual  and  group 
graphs.   The  group  graph  was  posted  in  the 
staff  office.   The  experimenter  met  with 
each  trainer  separately  and  reviewed  his 
or  her  individual  graph.   In  addition  to 
delaying  the  feedback  and  putting  it  into 
graphic  form,  a  fading  strategy  was  employ- 
ed.  The  following  schedule  was  used  to 
gradually  fade  the  number  of  staff  per- 
formance reviews:   first  two  weeks  -  six 
observations;  second  two  weeks  -  four 
observations;  third  two  week  -  two  obser- 
vations; fourth  two  weeks  -  one  observa- 
tion. 

Phase  1_   (follow-up)  —  At  the  beginning  of 
this  phase,  an  experimenter  announced  that 
there  was  no  need  to  spend  any  more  time 
on  monitoring  mealtime  training,   and  the 
group  performance  graph  was  removed  from 
the  staff  office.   Three  follow-up  obser- 
vations at  four -week  intervals  were  con- 
ducted, during  which  nothing  was  said  to 
staff.   If  the  observer  was  asked  why 
another  observation  was  being  done,  an 
ambiguous  answer  was  given.   Only  staff 
members  who  were  in  previous  active 
phases  were  included  in  follow-up  observa- 
t  ions . 

Results 

Figure  1  shows  the  results  of  this  study. 
Even  though  the  staff  had  recently  com- 
pleted a  one-week  training  program,  the 
average  percentage  of  appropriate  training 
behavior  at  baseline  was  only  13.3%.   The 
introduction  of  homogenous  grouping  and 
signs  with  individualized  training  target 
behaviors  resulted  in  an  improvement  in 
training  behavior.   The  average  percentage 
of  appropriate  training  behavior  during 
this  phase  was  29%. 

The  addition  of  immediate  feedback  led  to 
a  rapid  improvement  in  the  percentage  of 
appropriate  training  behavior.   The  average 
percentage  of  appropriate  behavior  was  45% 
during  the  third  phase.   When  the  feedback 
was  abruptly  dropped,  there  was  a  drop  in 
performance  to  a  33%  average  of  appropri- 
ate behavior.   Reinstatement  of  the  verbal 
feedback  resulted  in  a  return  to  the 
earlier  level  of  performance,  with  an 
average  percentage  of  appropriate  behavior 
of  43.8%. 

Surprisingly,  the  staff  performance  did 
not  drop  during  the  maintenance  strategy; 


it  rose  slightly  (average  appropriate 
behavior  44.1%).   The  three  follow-up  data 
points  at  four-week  intervals  show  little 
decline  in  training  performance.   The 
decline  was  only  3.8%  in  average  training 
performance  between  the  maintenance  phase 
and  the  follow-up  phase,  in  which  the 
percentage  was  40.3%. 

Discussion 

Training  skills  learned  in  the  inservice 
training  class  did  not  immediately  gen- 
eralize to  the  cottage  setting,  as  was 
seen  in  Phase  1  (baseline).   Staff  were 
observed  to  be  constantly  doing  things  for 
the  resident  (e.g.,  putting  food  on  their 
plates  or  feeding  them)  or  giving  cues 
without  following  with  a  consequence 
(reinforcer  or  correction  procedure). 

Homogenous  grouping  in  Phase  2  seemed  to 
improve  training;  trainers  under  the 
heterogenous  grouping  system  had  tended  to 
spend  a  greater  portion  of  their  time  with 
the  higher  functioning  clients.   With  the 
institution  of  the  homogenous  groupings, 
trainers  began  to  assign  themselves  to 
specific  tables  rather  than  having  every- 
one exercise  general  responsibility  for 
the  whole  group. 

In  Phase  3,  immediate  feedback  by  the  ex- 
perimenters was  popular  with  the  staff. 
Many  staff  members  expressed  pleasure 
about  receiving  "expert"  opinions  on  their 
performance.   As  stated  earlier,  most  of 
the  feedback  about  staff  performance 
attempted  to  decrease  the  staff's  rein- 
forcement of  dependent  behavior  (doing 
tasks  for  the  clients),  to  remind  the 
staff  to  give  a  consequence  for  each  cue 
they  gave,  and  to  improve  the  overall  rate 
of  reinforcing  comments  to  the  clients. 
Almost  every  data  point  in  the  feedback 
phase  was  above  the  data  points  in  the 
previous  phase.   As  in  other  studies, 
though  (Cooper,  e£  al.,  1970;  Kazdin, 
1974;  Martin,  1972),  when  the  feedback  and 
social  reinforcement  were  withdrawn  in 
Phase  4,  the  staff  performance  returned  to 
a  lower  level.   Reinstatement  of  the 
feedback  in  Phase  5  resulted  in  an  im- 
provement in  performance  to  the  level  of 
the  previous  feedback  phase. 

It  was  expected  that  in  Phase  6,  the 
maintenance  strategy,  the  staff  perform- 
ance would  drop  because  the  feedback  was 
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SESSIONS 

Figure  1.   Percentage  of  Intervals  with 
Appropriate  Staff  Behavior 


A  -  Baseline 

B, -  Signs /Grouping 

Ci -  Signs /Grouping/ 

Feedback 

Follow-up 

(Signs/Grouping) 


B 


C2-  Signs/Grouping/ 

Feedback 
D  -  Delayed  Feedback/ 

Graphing/Fading 
B3 -  Follow-up 

(Signs/Crotii-i  ng) 


delayed  until  after  lunch  and  was  nol 
given  as  often.   This  expected  decrease 
did  not  occur.   Overall,  there  was  a 
slight  improvement  in  appropriate  training 
behavior  (.3%)  between  the  feedback  and 
maintenance  phases.   A  major  reason  tor 
this  result  may  have  been  the  use  ot 
graphic  feedback  as  a  part  of  the  main 
tenance  strategy.   Even  though  the  indi- 
vidual graphs  were  not  publicly  posted, 
staff  members  were  extremely  interest ed  in 
their  graphic  results.   During  their 
coffee  breaks  after  lunch,  the  stafi  ot ten 
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discussed  their  percentages  for  the 
day,  which  may  have  caused  some  com- 
petition among  them. 

The  amount  of  decline  seen  in  the 
follow-up  observations  was  low. 
Based  on  averages,  the  decline  was 
only  3.5%  when  compared  to  the 
immediate  feedback  phase  and  3.8% 
from  the  maintenance  phase.   There 
was  a  slight,  unplanned  modifica- 
tion of  the  study  during  this  phase: 
the  shift  supervisor,  who  did  not 
know  about  the  purpose  of  the  study 
or  the  collection  of  follow-up  data, 
made  a  change  in  the  seating  arrange- 
ments of  about  one-fifth  of  the  resi- 
dents one  day  prior  to  the  second 
"^  follow-up  observation. 

Overall,  the  maintenance  strategy 
appeared  effective,  as  shown  by 
the  three  months  of  follow-up  data. 
When  compared  to  the  phase  in  which 
feedback  was  abruptly  dropped  (Phase 
4),  the  influence  of  delayed,  graphic 
feedback  which  was  systematically 
faded  out  showed  the  highly  de- 
sirable result  of  continued  high 
training  performance. 
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MONTANA'S  CHILD  AND  FAMILY  SERVICES 

BY  RON  LANGWORTHY,  DIRECTOR,  SPECIAL 
TRAINING  FOR  EXCEPTIONAL  PEOPLE, 
BILLINGS,  MONTANA 


The  same  year  (197S)  thai  Montana's 
legislature  increased  funding  for  boulder 
River  School  and  Hospital  by  111,    a  bill 
was  passed  to  create  the  Developmental 


Disabilities  Division  of  Social  and  Rehab- 
ilitative Services.   The  Division  carried 
the  mandate  to  develop  and  monitor  com- 
munity programs.   Eventually  a  network  of 
Child  and  Family  Service  agencies  (C&FS) 
was  created,  funded  by  a  combination  of 
Title  XX  and  state  monies.   These  Child 
and  Family  Services  were  seen  as  the 
preventative  edge  of  the  overall  system; 
that  is,  after  adult  services  were  set  up, 
It  became  apparent  that  it  would  also  be 
necessary  to  support  the  parents  of  school- 
aged  children  and  children  under  the  age 
of  six  in  order  to  maintain  a  comprehen- 
sive deinstitutionalization  program. 

Today  there  are  six  C&FS  agencies,  one 
each  in  four  of  Montana's  five  regions  and 
two  in  the  geographically  huge  Region  I. 
These  six  agencies  provide  a  wide  range  of 
services  to  parents  who  have  handicapped 
children  in  the  home.   The  families' 
participation  is  completely  voluntary  and 
free  of  cost.   The  service  is  offered  as  a 
supplement  to  school  services  if  the  child 
is  of  school  age.   C&FS  concentrates  on 
the  hard-to-serve,  that  is,  the  younger 
clients,  the  multihandicapped,  and  those 
whose  care  poses  a  stress  on  the  family. 

The  services  focus  more  on  the  parents 
than  on  the  child.   If  we  teach  parents 
training  skills,  they  can  become  indepen- 
dent trainers  of  their  children.   We  can 
thus  serve  more  people.   The  services 
designed  to  accomplish  this  have  been 
categorized  into  family  training,  client 
training,  family  resources  and  support, 
family  services  coordinates,  and  informa- 
tion and  referral. 

Family  training  involves  teaching  parents 
the  skills  necessary  to  become  Lhe  primary 
behavior  change  agents  for  their  children. 
Thus,  we  might  teach  a  parent  the  same 
skill  that  paraprofessional  trainers 
master  in  the  Boulder  Training  Center, 
such  as  baselining,  prompting,  shaping, 
fading,  cueing,  consequating,  and  collect- 
ing data. 

Direct  client  training  is  not  emphasized, 
but  occasionally  parents  are  unable  to 
carry  out  the  needed  training  programs, 
In  such  cases,  a  C&FS  agency  will  send  out 
a  Home  Teacher  to  work  with  their  child. 

Kami ly  resources  and  support  encompasses 
non-training  services,  such  as  transpor- 
tation, educational  information,  special- 
ized evaluations,  adaptive  equipment, 
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technical  assistance,  crisis  intervention, 
and  socio-educational  support  (including 
limited  counseling).   Through  this  category, 
Home  Teachers  can  offer  parents  small 
amounts  of  money  as  an  incentive  to  carry 
out  training  programs  which  otherwise 
might  not  be  attempted. 

The  purpose  of  service  coordination  is  to 
provide  effective,  efficient  service  to  a 
family.   Home  Teachers  try  to  maximize  the 
services  available  to  a  family,  which 
often  means  referral  to  other  agencies 
followed  by  coordination  of  all  services 
received  by  the  family.   Closely  related 
to  this  function  are  the  Information  and 
referral  activities  of  C&FS. 

C&FS  agencies  also  commonly  administer 
respite  services.   Respite  helps  parents 
who  have  handicapped  children  or  adults 
living  at  home  to  find  people  who  will 
assume  care  of  the  clients  for  short 
periods.   The  C&Fs  agency  then  reimburses 
parents  for  the  cost.   This  is  a  prevent- 
ative maintenance  program  that  recognizes 
the  long-term  wear  and  stress  often  caused 
by  caring  for  the  handicapped  individual 
in  the  natural  or  foster  home. 

Of  the  six  C&FS  agencies,  the  ones  in 
Billings  and  Creat  Falls  operate  child- 
ren's group  homes.   One  purpose  of  these 
group  homes  is  to  provide  transitional 
placement  where  the  clients  can  be  taught 
the  skills  necessary  to  move  into  a  less 
restrictive  setting,   that  is,  the  natural 
or  a  foster  home. 

On  the  whole,  however,  Child  and  Family 
Services  are  home-based,  rather  than 
center-based.   Family  trainers  travel 
their  regions  routinely,  visiting  the 
homes  of  clients  on  their  caseloads. 
Caseloads  vary  according  to  administrative 
support  and  the  travel  involved,  but  they 
generally  average  15  clients. 

Montana's  Cil'S  network  saves  tax  dollars 
in  the  long  run  by  supporting  least  re- 
strictive alternatives  in  caring  for  the 
developmental  1 y  disabled.   Considering  the 
residential  placement  alternatives,  as  an 
example,  group  homes  are  less  expensive, 
than  the  institution,  foster  homes  are 
less  expensive  than  group  homes,  and 
natural  homes  are  less  expensive  than 
toster  homes.   By  emphasizing  the  Lnteg 
rity  of  the  natural  home,  C&FS  attempts  to 
maintain  that  alternative.   Early  inter- 
vention with  young  children  also  saves 


money  by  avoiding  more  costly,  more  re- 
strictive alternatives  in  the  educational 
range  of  services. 

Child  and  Family  Services  thus  provide  a 
wide  range  of  services  intended  to  prevent 
Institutionalization,  lessen  the  severity 
of  disabilities,  and  soil  en  the  impact  of 
handicapped  children  in  Montana  families. 
Family  training  and  support  are  the  vital 
elements  in  a  service  system  that  is 
seriously  striving  for  deins ti tutionali- 
zat  ion. 


A  REDUCTION  OF  AGGRESSION  THROUGH 
REPRIMAND,   REMOVAL  AND  DRO 

BY  ALAN  B1CKETT  &  BARRY  COHEN 

METHOD 

Subject 

Jim  is  a  nineteen-year-old,  profoundly 
retarded  male  with  Down's  Syndrome.   He 
was  institutionalized  at  the  age  of  one 
month  and  has  resided  at  Boulder  River 
School  and  Hospital  since  1969.   Jim  has  a 
long  history  of  aggression,  principally 
slapping,  hitting,  and  shoving,  and  has 
lived  in  the  cottage  where  this  program 
was  conducted  for  two  years  prior  to  the 
initiation  of  the  present  study. 

Dependent  Variable 

The  target  behaviors  were  defined  as 
"hitting,  kicking,  or  pushing  residents  or 
staff,  or  throwing  objects  at  residents  or 
staff."   Each  time  one  or  more  of  the 
target  behaviors  occurred,  staff  were 
required  to  record  the  date,  time,  spe- 
cific behavior (s),  and  the  observer's 
Initials  on  a  data  grid  which  was  posted 
on  a  window  between  the  dayhall  and  the 
major  hallway  of  the  cottage.   Unfortun- 
ately, no  formal  reliability  measures  were 
taken,  but  informal  observations  by  the 
authors  indicated  that  the  data  were 
reliable  and  that  reliability  was  consis- 
tent across  conditions. 

Experimental  Conditions 

Basel ine.   During  the  baseline  condition, 
cottage  st      re  instructed  to  record 
occurrences  of  the  target  behaviors.   No 
instructions  were  given  on  the  delivery  of 
any  consequence  tor  the  behaviors.   During 
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this  phase,  Jim  was  generally  moved  away 
from  any  person  he  aggressed  against.   He 
was  often  reprimanded,  and,  on  a  few 
occasions,  he  was  required  to  stand  in  a 
corner  for  a  short  period  of  time. 
Reprimand,  Removal  and   PRO.   During  this 
condition,  occurrences  of  the  target 
behaviors  were  followed  by  a  verbal  repri- 
mand ("No,  Jim,  you  don't  . "),  and  by 

the  removal  of  Jim  to  an  area  at  least  30 
feet  from  the  place  in  which  the  behav- 
ior(s)  occurred.   This  usually  meant  that 
Jim  was  removed  to  his  bedroom.   In  addi- 
tion to  these  punitive  procedures,  Jim  was 
placed  on  a  schedule  by  which  he  was  to  be 
socially  reinforced  by  staff  on  the  PM 
shift  (2:00  PM  -  10:00  PM)  at  least  once 
every  15  minutes  unless  the  target  behav- 
ior (s)  had  occurred  within  two  minutes 
preceding  a  scheduled  reinforcement  time. 
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Strike.   A  five-week  strike  at  BRS&H 
resulted  in  the  cottage  being  staffed  by 
non-union  personnel,  only  one  of  whom 
normally  worked  in  the  cottage,  and  by 
groups  of  National  Guardsmen,  who  rotated 
through  the  cottage  approximately  every 
eight  days.   During  this  period,  the  same 
procedure  of  reprimand,  removal,  and  DRO 
was  kept  in  effect  for  Jim's  aggressive 
behaviors.   National  Guardsmen  were  given 
brief  instructions  on  its  implementation 
during  their  orientation  to  the  cottage. 

Reprimand,  Removal  and  15-Minute  DRO. 
During  this  condition,  the  procedures  were 
identical  to  those  used  in  the  first 
intervention  condition.   This  condition 
began  immediately  upon  the  return  of  the 
regular  cottage  staff  following  the  strike. 

DRO  Fading.   During  subsequent  conditions, 
the  time  between  scheduled  DRO  interac- 
tions was  increased  to  30  minutes,  60 
minutes,  and  finally  eliminated  completely. 

RESULTS 

As  the  graph  clearly  shows,  the  initia- 
tion of  the  described  procedure  coincided 
with  a  sharp  decrease  in  the  incidents  of 
aggression  on  both  the  AM  and  the  PM 
shifts.   During  the  strike,  there  was  an 
increase  in  the  number  of  lim's  aggressive 
incidents,  but  as  the  strike  continued, 
the  frequency  of  aggressive  acts  declined. 
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The  fading  of  the  DRO  procedure  was  suc- 
cessful; Jim's  rate  of  aggression  was 
lower  during  the  final  removal  and  repri- 
mand condition  than  it  had  been  during 
either  condition  of  removal  and  reprimand 
with  the  DRO.   The  mean  number  of  inci- 
dents of  aggression  per  week  for  the 
respective  conditions  was  52,  22,  20,  20, 
6,  4,  and  4  on  the  PM  shift  and  54,  14, 
21,  5,  4,  2,  and  1  on  the  AM  shift. 
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DISCUSSION 

The  results  described  above  may  be  faulted 
for  both  the  weakness  of  the  design  and 
the  lack  of  a  reliability  measure.   The 
results,  however,  do  suggest  that  the 
reprimand,  removal,  and  DRO  procedure  was 
successful  in  reducing  aggressive  behavior 
in  an  institutionalized  resident  who  had  a 
long  history  of  such  behavior.   The  proce- 
dure also  appears  to  have  been  effective 
during  the  strike  period,  which  indicates 
that  it  was  effective  even  under  disrup- 
tive conditions  and  that  it  can  be  imple- 
mented consistently  by  staff  with  only 
minimal  training  and  experience  working  in 
the  cottage. 

Interestingly,  the  rate  of  aggression 
decreased  across  both  work  shifts,  even 
though  the  DRO  component  was  implemented 
only  on  the  PM  shift.   Anecdotal  evidence 
indicates  that  generalization  of  positive 
social  interaction  was  occurring  across 
shifts.   however,  the  design  of  this  study 
does  not  enable  the  analyst  to  reliably 
discern  if  generalization  was,  in  fact, 
occurring  or  if  the  DRO  schedule  simply 
was  not  an  operant  factor  in  the  reduction 
of  the  target  behaviors. 

The  rate  of  the  behaviors  continued  to 
remain  low  even  after  the  complete  removal 
of  the  DRO  component;  this  is  an  important 
result  for  those  of  us  who  have  to  deal 
with  a  large  number  of  behavior  problems 
simultaneously.   Staff  have  noticed  that 
DRO  procedure  seemed  to  increase  the 
frequency  with  which  Jim  attempts  to 
engage  staff  in  appropriate  interactions. 
Thus,  it  appears  that  he  has  learned  an 
alternate,  more  appropriate  means  of 
getting  attention.   It  is  hoped  that 
further,  more  controlled  efforts  will  be 
made  to  test  this  simple,  potentially 
effective  procedure. 

NOTES  FROM  THE  BTC 

Several  events  have  occurred  in  the 
Boulder  Training  Center  over  the  past 
year.  Most  notably,  the  staff  of  the 
BTC,  along  with  the  Director  of  Staff 
Development,  James  Burgess,  have  com- 
pleted two  major  projects. 
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The  first,  an  assessment  of  the  train- 
ing effort  under  the  Boulder  Training 
Model,  was  completed  in  June  of  19  79. 
This  evaluation  reviewed  three  years  of 
activity  since  the  training  model  was  im- 
plemented and  examined  the  extent  to 
which  the  training  model  has  been  estab- 
lished and  maintained  in  separate  areas  of 
the  institution.   A  summary  of  the  assess- 
ment, by  Plaska,  Burgess  and  Tillema,  ap- 
pears in  this  issue  of  the  Boulder  Beha- 
viorist . 

The  assessment  pointed  out  several  defi- 
ciencies in  the  maintenance  of  the  train- 
ing model,  most  notably  in  the  ongoing  de- 
livery of  training  services.   On  the  whole, 
these  deficiencies  were  seen  as  resulting 
from  the  lack  of  management  procedures 
that  maintain  high  levels  of  training 
skills  and  program  delivery. 

With  the  objective  of  developing  cost- 
feasible  and  effective  staff  management 
procedures,  the  BTC  staff  have  applied 
for  a  grant  under  the  Handicapped  Field 
Initiated  Research  program  of  the  Bureau 
of  Education  for  the  Handicapped.   The 
proposed  project  is  designed  to  study 
the  effects  of  four  staff  management  pro- 
cedures on  the  adaptive  behavior  changes 
of  the  residents  at  BRS&H.   Other  depen- 
dent variables  include  the  quality  and 
quantity  of  services  delivered  to  the  re- 
sidents. 

The  main  focus  of  the  research  would  be 
a  comparison  of  self -monitoring  of  training 
behaviors  by  direct  service  staff  and  the 
monitoring  of  those  behaviors  by  first- 
line  management  personnel.   In  addition, 
each  procedure  would  have  conditions  in 
which  positive  contingencies  for  training 
behaviors  would  be  administered.   The  ef- 
fects of  these  contingencies  could  then 
be  compared  to  the  effects  of  simple  feed- 
back (supplied  by  self-monitoring  or  su- 
pervisor monitoring). 

Completion  of  the  research  would  result 
in  the  implementation  of  the  most  effec- 
tive procedures  throughout  the  institution. 
Secondarily,  the  results  generated  by  the 
research  would  be  made  available  to  the 
public;  staff  management  has  attracted 
considerable  interest  in  the  past  few 
years,  yet  a  hard  comparison  of  the  pro- 
cedures outlined  above  has  so  far  been 
neglected. 
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In  December,  Mary  Tillema,  the  Director 
of  the  BTC  for  the  past  two  years,  re- 
signed to  accept  a  postion  as  research 
director  for  a  group  home  corporation  in 
Ann  Arbor,  Michigan.   An  instructor  in  the 
training  center,  John  Moore,  has  been 
hired  as  director,  and  Linda  Poniktera- 
Olson,  a  recreation  therapist  at  BRS&H, 
has  joined  the  ranks  as  an  instructor. 

At  present,  the  training  center  is  in- 
volved with  the  ongoing  training  of  newly 
hired  staff.   Through  an  arrangement  with 
Western  Montana  College  at  Dillon,   train- 
ees may  now  receive  college  credit  for 
completing  the  BTC  course  as  well  as  for 
going  through  other  Staff  Development 
programs.   The  training  center  is  also 
working  with  the  staff  of  individual 
cottages  at  BRS&H  to  maintain  the  training 
model  at  a  high  level. 
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POSITIONS  AVAILABLE 

Immediate  opening  for  Recreation  Thera- 
pist.  Salary  Range  from  $1,287  to  $1,696 
per  month.   Trains,  supervises  and  coord- 
inates professional  employees  providing 
therapeutic  recreation  services  to  devel- 
opmen tally  disabled  persons.   Prefer 
Masters  Degree  in  Recreation  Therapy  with 
one  year  of  professional  experience. 
Excellent  benefits. 

Immediate  opening  for  Registered  Nurse. 
Graduates  of  two-,  three-,  or  four-year 
accredited  RN  programs  considered.   Salary 
range  from  $1,175  to  $1,549  per  month. 

Immediate  opening  for  Physical  Therapist 
II.   Salary  range  from  $1,287  to  $1,696 
per  month.   Assists  in  planning  and  direct- 
ing therapy  programs,  trains  technicians, 
consults  with  professionals,  and  admin- 
isters therapy  to  developmentally  disabled 
clients.   Bachelors  degree  in  Physical 
Therapy  and  completion  of  internship 
required.   Must  be  licensed  or  eligible  in 
Montana.   Excellent  benefits. 

Please  direct  inquiries  concerning  the 
above  positions  to  Boulder  River  School 
and  Hospital,  Personnel  Office,  P.O.  Box 
87,  Boulder,  MT  59632  or  phone  (406)  225- 
3311,  ext.  284. 
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